Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist
نویسندگان
چکیده
In a regular full exponential family, the maximum likelihood estimator (MLE) need not exist in traditional sense. However, MLE may completion of family. Existing algorithms for finding solve many linear programs; they are slow small problems and too large problems. We provide new, fast, scalable methodology This is based on conventional computations which come close, sense, to These construct maximizing sequence canonical parameter values goes uphill function until meet convergence criteria. Nonexistence this context results from degeneracy statistic boundary its support. There correspondance between null eigenvectors Fisher information matrix. Convergence along follows cumulant generating (CGF) sequence, conditions given. allows construction necessarily one-sided confidence intervals mean value parameters when exists completion. demonstrate our three examples main text additional an accompanying technical report. show that provides statistical inference much faster than existing techniques.
منابع مشابه
Targeted Maximum Likelihood Estimation using Exponential Families.
Targeted maximum likelihood estimation (TMLE) is a general method for estimating parameters in semiparametric and nonparametric models. The key step in any TMLE implementation is constructing a sequence of least-favorable parametric models for the parameter of interest. This has been done for a variety of parameters arising in causal inference problems, by augmenting standard regression models ...
متن کاملThree Papers on Maximum Likelihood in Exponential Families
General methods for obtaining maximum likelihood estimates in exponential families are demonstrated using a constrained autologistic model for estimating relatedness from DNA fingerprint data. The novel features are the use of constrained optimization and two new algorithms for maximum likelihood estimation. The first, the "phase I" algorithm determines the support of the MLE in the closure of ...
متن کاملLikelihood Inference in Exponential Families and Directions of Recession
When in a full exponential family the maximum likelihood estimate (MLE) does not exist, the MLE may exist in the Barndorff-Nielsen completion of the family. We propose a practical algorithm for finding the MLE in the completion based on repeated linear programming using the R contributed package rcdd and illustrate it with two generalized linear model examples. When the MLE for the null hypothe...
متن کاملLecture 22: Maximum Likelihood Estimator
In the first part of this lecture, we will deal with the consistency and asymptotic distribution of maximum likelihood estimator. The second part of the lecture focuses on signal estimation/tracking. An estimator is said to be consistent if it converges to the quantity being estimated. This section speaks about the consistency of MLE and conditions under which MLE is consistent.
متن کاملComputationally Efficient Gaussian Maximum Likelihood Methods for Vector ARFIMA Models
In this paper, we discuss two distinct multivariate time series models that extend the univariate ARFIMA model. We describe algorithms for computing the covariances of each model, for computing the quadratic form and approximating the determinant for maximum likelihood estimation, and for simulating from each model. We compare the speed and accuracy of each algorithm to existing methods and mea...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronic Journal of Statistics
سال: 2021
ISSN: ['1935-7524']
DOI: https://doi.org/10.1214/21-ejs1815